DOCOMENT BESDHE 



ED 126 0&2 

aoqiHos 

TITLE 

IHSTITDTION 

SPONS AGENCY- 

PDB DATE • 
NOTE 



SDRS PHICI 
DESCHIFTOBS 



. 95 



SP 010 '281, 



IDEHTIFIEES 



BuSh^ Bobert'N. - . • \ . 

Educational Research'and Public Policy: Problems and 
Promise. Occasional Paper No. 12. 

Stanford ^Dniv. ^ Calif. Stanford Center for Research 
and Development in Teaching.' 

National Inst, of Education (DHEH) , Washington, 
Jun 76 

lOp.; Paper presented at Annual Meeting of the 
American Educational Research Association (San 
Francisco Cali fjQxn ia^__ April __20j^ A^Jf>) » 

HF-$0.83 .HC-$1 .67 Plus Postage. 
Beginning 1?eaciirers; Educational Development; 
Educational Policy; *Educatioiral Research; . ^ 
Educational Researchers; Pbli9y Fofmation;. *Publlc 
Policy; ^Research Problems;' Research Utilization; , 
♦Teacher Evaluation 

♦California Beginning Teacher Evaluation Study 



ABSTRACT ^ ^ 

The art of relating educational research to public 
policy is still primitive. EdWational policy is forped mainly by 
tradition and the political pressure of interest groups, ' while 
educational researchers study questions' determined by the scientific 
cdmmunity^. Educational research has not noticeably influenced policy 
because trained researchers have ieen too few, resources too limited, 
'and.ef|orts too fragmented. The ^eed for illuminating educational 
policy by research is great, and the situcition is becoming serious. 
The California Beginning Teaqher Evaluation Study, which illustra-tes 
cooperation between educational* policy makers and researchers' 
includes these aspects: (1) the study is a genuine cooperative , 
venture between the policy makers and researchers; (2) it has hafl 
sufficient funding from the several million dollars available to. 
develop new programs; (3) the research and its eventual application 
requires time, which is available; (4) the study has been flexible in 
its planning and implementation stages; (5) the policy makers and the 
researchers meet together 'continupusly, and each teaches the' other; 
(6) the ptoject has had continued advice, to which it has listened, 
from a broad spectrum of persons^on a research advisory^ board; (7) 
the research and policy effort has been continuous; and' (8) the 
project is taking advantage of' ospinof^ s. If this sturdy is a good 
example of research relevant to publiq policy ,' theij educators are 
moving from a primitive state of organizing researdh and policy, 
(SK) . 
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Introductory Stat-^ment 

«. 

The mission of the Stanford Center for Research and Development 
in Teaching is to improve teaching in American schools. Current major 
operations include three research afid development progfams--Teaching 
Effectiveness, The Environment .for 'Teaching, and Teaching and li'nguistic 
IJluralism--and two programs combining reseai^ch and technical assistance, 
the Stanford Urban/Rural Leadership Training Institute and the Hoover/ 
Stan ford Teacher Corps Rroject, The ERIC Clearinghouse on ^Informat ion 
Resources is also a part of the Center, A program of exploratory arid re- 
lated studies provides for smaller studies not part of the maj9r programs 



This 'paper sets forth certain characteristics of California's 
Beginning Teacher Evaloiation Study which may point 'the way to a more 
fruitful interaction between educational research and public policy. 
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EDUCATIONAL RESEARCH AND PUBLIC POLICY: 
PROBLEMS AND PROMISE 

Robert Bush 

Lex me begin by observing that the state of the , art in relating ' ^ 
educational research tct public policy, is extremely primitive. It is 
much-easier to begin with the problems than the promise side,. since 
there is so much^more to talk about/ 

Problems 

« 

In the words of C. P, Snow/ there are indeed two worlds, and in 
this case, as with oil and .water, they seem almost impossible to mix,><' 
They are like theo^'ry and practice. 

The researcher and the policy maker ask diffe^^nt jJ|uestions, As 
Fred McDonald statre^d in the provocative and illuminating paper he de- 
livered at the -University of Texas meeting in October 1975, entitled ^ 
''Research on Teaching and Its Emphasis foi? Policy Making": VThe re- 
searcher may contemplate jumping the broo]S:; the policy maker must jump 
it." The researcher and the policy maker ^e bothered'by different prob- 
lems. They march to different drummers. They speak different languages. 
Each is shaped by his own set of priori t^ies. The policy maker must find 
an acceptable answer to a pressing problem. The researcher is answerable 
to his colleagues about the reliability/ and validity of his instruments, 
the adequacy of his sample,^ the generaliizability of his findings, the 
elegance of his design--not about the nature and importance of his problem 

Educational policy is formed mainly by tradition and the political 
pre.ssUre .of interest groups, not very much illuminated or influenced by 



olid .information about the potential efficacy of a particular policy 



These remarks were presented at a symposium on Educational Research 
and Public Policy at the annual meetipg -of the American Educational 
Research Association, San Francisco, April 20, 1976, 



It is more difficult to tell from whence research in education takes 
its cues as to the, problems it selects for study. But the cues do not 
usually come from the polic/ makers. How researchers phrase their ques- 
tions is determined mainly by the scientific community, anti^^s a result, 
'their findings usually have Jittle to say to the real world of the policy 
.maker. It is in education -generally true, as McDonald stated in the paper 
just referred to about teaching, that "It should be obvious that research 
on teaching has not reached the point that it can be used to inform 
policy decisions in any substantial way:" 

Seldom are the policy questions that need illumination formulated 
clearly enough to guide^ research efforts^ Seldom is there enough time, 
money, and favorable environment for the policy maker and the researcher 
to work together, Somt of these serious p2??>t^lem3 may be in the process 
of solution in tbe California Beginning Teacher Evaluation Study, and J 
will comment on them later under the heading of "promise/* . 

Educational research has not noticeably influenced palicy or prac- 
tice for a Variety of reaspns. Trained researchers have been too few, * 
the resources too limited, efforts^ too. fragmented.. Research has been* 
directed to small, isolated parts of the' total system, ^he methodologies 
and samples have been so diverse as to preclude cumulative effect; the 
methjpds have unduly "copied designs from the natural sciences and have 
dften been inappropriate' for the probleins under consideration. Until 
quite recently, "much educational research has been carried on by indi- 
vidual professors and a few graduate students working on doctoral dis- 
sertations, whose results were filed only to gather dust on library 
shelves. 

Even though the problems are great, the need for illuminating edu- 
cational policy by research is even greater* We repeatedly embark upon 
large spending that stems from assumptions and educational -policies that 
have little or no foundation in fact. Both the press and professional 
literature abound with new examples. Stephen Bailey, for example, pointed 
to one such situation whiJ^e_jj^ ng the efficiency of spending billions 
of dollars to help millions of underachievers in oJr schools^ with the 
comment that "the evidence is increasinglry clear that our educational 
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system is woefully unprepared to use. marginal additional money effectively 
for the redress of educational disadvantage'* (Bailey, 1^70)., Currently, , 
there is great emphasis upon ''mainstreaming/* In a, recent .issue bf 
Education Daily, the testimony of Yale psychologist Edward Zigler to 
Congres's concerning support for research on the mentally retarded is head- 
lined as ''skeptical on mainstreaming/' Zigler pointed pnt that several 
years ago experts convinced decision makers that special education was' 
the ^ solution to the problam of training the mentally retarded. Now that 
special education is looUed upon as an undBsirable form of grouping or 
segregation, the pendulum begins to swing in the opposite direction. 
Decision ^nakers are now committing thepis^lyes to. such concepts as ''ilor- 
malization" ani^ **de-institXitionalizatioft** under the heading of "main- ^ 
streaming." Zigler^states: "I join with my senior workers in the field 
who view these concepl^^ ^ little more than slogans that are badly in 
need of a data base.'* Yet w<^already find states passing laws mandating 
mainstreaming before there are'an>^^asic' data t,o support ^it. As Zigler 
says, *'It makes little sense to appropl^i^ate hundreds of millions of dol- 
lars on questionable social practices and f^J. to find a few mi 1 lion ^f or 
researchers^ committed to discovering the actual effects of su^h practices*' 
(quoted in Education Daily , Mdrch 22, 1976). ^ ^ 

The situatipn is serious and time may be runn^ing out. -While 'ai?i' 
not one^ of the prophets of the impending doom of the school systd™ I 
confess to an increasiivg disquietude that we may be' losing grouna^nd 
that we in education may not be moving foward fast enough to keep pace 
with the surrounding forces. Fred\ Hechinger, writing in a recent issue 
of Saturday Review under an alarming headline entitled, *'Murder in Academe: 
The Demise of Education,** suggests that as a result of assaults both 
from the left and thp right, education is lijterally hanging on the ropes. 
He claims that we have lost our faith in .l;he" efficacy of education in 
schools to keep our social system open and tVy^eep the streams of .upward 
mobility unclogged. ' . ' 

Promise ' J ' 

There are, as I indicate, problems. I could enumerate others, "but 
perhaps I should leave a few ftor my colleagues on the panel. What of 



the promise side of the ledger?| First, we are beginning to recognize 
the protQem. This meeting is dn example. If one studies the AERA agenda, 
one sees the word "policy*' 2keci more frequently in the last few years. 
Several educational policy ceriters have been established in the last 
deeade. More promising even ^rhan such centers, which in some cases are 
perhaps too future oriented, are the instances of policy makers spending 
more time and resources to hire ^researchers to help them answer their 
policy quest ions--and, furthermore, keeping the researchers to the task. 
My chief experience in such a large-scale effort has been with the Cali- 
. fornia^'Beginning Teacher Evaluation Study. It is a promising venture 
T.ndeed. ^Vhat in that experience has led me to suggest that there is 
promise .ahead? Let me list eight aspects that come quickly to mind. 
No doubt there aire others that my ooll^agues on the panel can suggest. 

1. The Beginning Teacher Evaluation Study is genuine cooperative 
venture between the policy makers and the researchers* It is a venture 
between a federal funding agency (the National Institute of Education), 
a state policy-making group (the California Commission for Teacher 
Preparation and Licensing), and a large, diverse advisory committee, all 
working closely together. * 

2. There is money available--several million dollars. We are 
breaking new territory. Such an effort always costs more the first 
time around, until a prototype has been developed. Later it may be 
possible to have. the kind of research that illuminates polic/ without 
^uch substantial expenditures as this one. 

3. The research arid JLts Eventual application requires time . The 
process cannot 4)e hurried, even though policy needs are jiressing. In 
most instances, research that will illufl^inate policy is not a short-term^ 
affair. ■ - ^ , * 

4. The Beginning Teacher Evali*ation Study has been flexible ; it 
has modified its attack and its plan as it has gone alqn^. It has not 
attempted to stay wedded to its original design. ^This has caused some 
travail, 4)ut on balance it has been wise to be open, flexible, and 
developmental in approach. . 
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5, The policy maker ^and the researchers meet together continuously , 
and eiich teaches the other. In my judgment, there has not been a suf- 
ficiently balanced exchange. Thus far the policy makers have done more 
listening than talking. The researchers have been more successful at . 

' influencing the policy makers to change thei-r questions than the policy 
makers have been in getting the researchers to modify their efforts to 
answer the questions that are important to the policy makers. Nonethe- 
less, there has been a genuine exchange, much more than is topically the 
V case, and it is increasing as the program goes forward. 

6, The project has. had continued advice, to which it has listened , 
from a broad spectrum of persons on a research advisory board. The ad- 
vice has not been narrow and doctrinaire. The panel includes a wide 
range of researchers, a wide range of practitioners, and a wide range 

of administrators and policy makers. The research advisory board has 
stayed^ together for a period of several y^ars. They are ajl^^ully ac- 
' quainted w^ith the project over it's long and complicated history^ The 
advice has not bfeen hit-and-run.- 

7. The research and policy effort has been contiajiuous . We have 
stuck tTo the problem persistently. Now, after several years, the project 
has reached Phase III, which is the end of current funding, but already 
there is talk about a needed Phase IV. 

8. The project is taking advantage of certain spin-offs . Both 

- the researchers and the policy makers are asking better kinds of ques- 
tions than ever before, questions that eiicompass a broader range of 
problems than in the begi^niling* The original policy question was quite 
specific: *'What can we lea-rn about teacher behavior that will enable 
us to formulate new teacher licensing requirements?" Now a multiple 
series of questions are being aske^l, not just about licensing but also 
about preservice^ t Training, in-service training, and the teacher's role 
in the improvement of instruction. This means a recognition on the 
part of both the policy maker and the researcher of the interdependency . 
of the different pa^rts of the total teaching system. We are beginning 
to get away from o'ur naive belief that great improvements in education 
will spring from piecemeal reforms such as introducing a new^method, a 

8 



new license, a new method of instruction, an in-service education program, 
the regrouping of learners, organizing te^achers into teams, or adopting 
a particular program of instruction. We are beginning to recognize the 
importance of compatible systems in which behavior of persons, the media r 
and context of communications, scheduling of activities, the reward sys- 
tem, and many other factors operate to produce effects. This recognition 
of the need to give attention to all elements, so crucial to system per- 
formance, is something new and promising in education. 

Just as one picture is worth a thousand word^S-,: so too is one good 
example worth a myriad theoretical statements, A good exaniple^f -research 
relevant to public policy may^^Be'in the making in the ..Beginning Teacher 
Evaluation Study of the California Commission for Teacher Preparation 
and Licensing. If this turns out to be the^case, we shall have moved 
fomard from the primitive state of the ^rt referred to at the beginning 
of these remarks, ^ . 
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